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10 TECHNICAL FIELD 

The present invention is related to methods and devices for use in cell phones 
and other communication systems that use statistical multiplexing wherein channels 
are dynamically allocated to carry each talkspurt. It is particularly directed to 
methods and devices for mitigating the effects of access delay in such communication 

15 systems. 



BACKGROUND OF THE INVENTION 

In certain packet telephony systems, a terminal only transmits when voice 

activity is present. Such discontinuous transmission (DTX) packet telephony systems 
20 allow for greater system capacity, as compared with systems in which a channel is 

allocated to a transmitting terminal for the duration of the call, or session. 

With reference to Fig. 1, in DTX systems, at the start of each talkspurt, the 

transmitting device 102, typically a wireless handset, requests a transmission channel 

from the base station 104. The base station 104, which uses statistical multiplexing 
25 for allocating channels, establishes a path via a network 106 and/or intermediate 

switches 108 to connect to the remote receiving device 110, which may be another 

handset, conventional land-line phone, or the like. 

Fig. 2 presents a block diagram of the principal functions of the transmitting 

device 102 and the base station 104 in a DTX system. A speaker=s voice is received 
30 by an audio input port (AIP) 122 where the voice signal is digitally sampled at some 

frequency fs, typically fs = 8 kHz, The sampled signal is usually divided into frames 



1 



of length 10 msec or so (i.e., 80 samples) prior to fiirther processing. The frames are 
input to a voice activity detector (VAD) 124 and a speech encoder 126. As is known 
to those skilled in the art, in some devices, the VAD 124 is integrated intathe speech 
encoder 126, although this is not a requirement in prior art systems. In any event, the 
VAD 124 determines whether or not speech is present and, if so, sends an active 
signal to the handset=s control interface 128. The handset=s control interface 128 
sends a traffic channel request over the control channel 130 to the traffic channel 
manager 132 resident in the base station 104. In response to the request, the traffic 
channel manager 132 eventually sends back a traffic chaimel grant to the handset=s 
control interface 128, using the control channel 130. Upon receiving the traffic 
channel grant, the handset=s control interface notifies the VAD 124, the speech 
encoder 126 and/or the handset=s bit-stream transmitter 134 that a traffic channel 136 
has been allocated for transmitting voice data. When this happens, the speech encoder 
126 encodes the speech frames and sends the encoded speech signal to the handset=^ 
bit-stream transmitter 134 for transmission over the traffic channel 136 to the 
appropriate bit-stream receiver 138 associated with the base station 104. In some 
devices, the speech encoder 126 prepares frames for transmission and sends these to 
the bit-stream transmitter, whether or not there is voice information to be transmitted. 
In such case, the transmitter does not transmit until it receives a signal indicating that 
the traffic channel 136 is available. 

In the above-described conventional system, there is delay between the time 
that frames emerge from the audio input port and the bit-stream transmitter 134 begins 
to transmit voice data. The overall delay includes a first delay associated with the 
time that it takes the VAD to detect that voice activity is present and notify the 
handset=s control interface prior to the traffic channel request, the AVAD delay@, and 
a second delay associated, with the time between the traffic channel request and the 
traffic channel grant, the Achannel access delay@. The length of the VAD delay is 
fixed for a given handset, and depends on such things as the frame length being used. 
The length of the channel access delay, however, varies from talkspurt to talkspurt 
and depends on such factors as the system architecture and the system load. For 
example, in the wireless voice over EDGE (Enhanced Data for GSM Evolution) 



system, the channel access delay is appkoximately 60 msec, and possibly more. 
Conventionally, mitigating any type of access delay entails either a) buffering the 
voice bit-stream until permission is granted, and thereby retarding transmission by 
that amount of time, b) throwing away i^eech at the beginning of each utterance 
5 (Ai.e., AjSront-end clippings) until permission is granted, or c) a combination of the 
two approaches. The buffering option introduces delay, which is detrimental to the 
dynamics of interactive conversations. Indeed, adding 120 msec of round trip delay 
just for access delay can break the overall delay budget for the system. The frontend 
clipping option often cuts off the initial consonant of each utterance, and thus hurts 
10 intelligibility. Fmally, combining the two options such that less clipping occurs at the 
expense of delay is less than satisfactory because such an approach suffers from the 
disadvantages of both. 

SUMMARY OF THE INVENTION 

15 The present invention is directed to a method and system for removing acosss 

delay during the beginning of each utterance as the talkspurt progresses. This is done 
by time-scale compressing, i.e., speeding up, the speech at the start of a talkspurt 
before it is passed to the speech coder. The speech is speeded up by buffering each 
talkspurt, estimating the speaker=s pitch period, and then deleting an integer number 

20 of pitch period=s worth of speech from the buffered talkspurt to produce a 

compressed talkspurt. The compressed talkspurt is then encoded and transmitted until 
the access delay has been fully mitigated, after which the incoming voice signal is 
passed through without further compression for the remainder of the talkspurt. 

In one aspect of the present invention, the speech is speeded up by between 

25 10-15%, so that a 60 msec delay is mitigated between the first 400-600 msec of a 
talkspurt. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention can better be understood through the attached figures in 

30 which: 
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Fig. 1 shows a conventional coiftmimication system to which the present 
invention pertains; 

Fig. 2 shows a functional block diagram of pertinent portions of a 
conventional transmitter; 
5 Fig. 3 shows a functional block diagram of pertinent portions of a 

communication device in accordance with the present invention; 

Fig. 4 shows a flow chart governing the operation of the communication 
device of Fig. 3; 

Fig. 5 shows a flow chart detailing the processing of a frame of voice data; 
10 Figs. 6a & 6b illustrate the eflfect of the present invention on a speech 

waveform; 

Fig. 7 illustrates the process for estimating the pitch period for a frame of 
voice data; and 

Fig. 8 shows an overlap-add method used in conjunction with removing a 
1 5 pitch period worth of data from frame of voice data. 

DETAILED DESCRIPTION OF THE INVENTION 

With reference to the communication device 140 and the base station 142 of 
Fig. 3, a speaker speaks into the AIP 150 which, in turn, outputs frames of speech. 

20 The frames of speech are input to both the Voice Activity Detector (VAD) 152 and 
the Access Delay Reducer (ADR) 154. The VAD makes a binary yes/no decision as 
to whether or not each input frame contains voice activity. If voice activity is 
detected, the speech frames are encoded by the speech encoder 156 and transmitted by 
the bit-stream transmitter 158 via the traffic channel 160 to the bit-stream receiver 162 

25 of the base station. On the other hand, when the VAD 152 detects no voice activity, 
the bit-stream transmitter 158 transmits no voice signal, although it may still transmit 
frames for comfort noise genaation (CNG), such as described in U.S. Patent No. 
5,960,389, during such periods of inactivity so that the background noise at the 
receiver matches that at the transmitter. 

30 The VAD 152 outputs an active signal, which indicates an inactive-to-active 

transition, both to the handset^s control interface 164 and the ADR 156, thereby 
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signifying that voice frames are present The handset=s control interface 164, in turn, 
informs the traffic channel manager 166 via the control channel 168 that a traffic 
channel is needed to send the bit-stream. The traffic channel manager 166, in turn, 
locates and allocates an available traffic channel and, after the access delay, Da, 

5 informs the handset=s control interface 164 by sending an appropriate message back 
over the control channel 168, which is sent on to the ADR 154. The traffic channel is 
requested and assigned by the traffic channel manager 166 at the start of each 
talkspurt. At the end of each talkspurt, the VAD 152 detects that no further speech is 
being generated, and sends an appropriate signal to the handset=s control interface 

10 164 which, in turn, informs the traffic channel manager 166 that the assigned traffic 
channel is no longer needed and now may be reused. 

When the ADR 154 receives the active signal from the VAD 152, it starts 
buffering the frames of speech in an internal buffer. And when the ADR 154 receives 
the signal from the control interface 164, it can determine the access delay Da. This 

1 5 can be done, for example, by use of a real time clock/timer associated with the 

communication device, or by measuring a >current position= pointer in the AIP 150 
both upon receiving the active signal (>voice present=) from the VAD 152 and also 
upon receiving the second signal (>channel established=), and taking the difference. 
In general the particular manner in which the ADR obtains the channel delay is not 

20 critical, so long as it has access to this information. 

In the present invention, the ADR 154 is configured to speed up the speech at 
the beginning of each utterance so as to make up for the access delay Da within some 
time period T. This is accomplished by compressing the speech by some speed-up 
rate r during the time period T. The speed-up rate r at which the access delay Da is 

25 mitigated is given by r = Da/T. It should be noted, however, that the speed-up rate r is 
a tunable parameter which may be selected, given latitude in adaptively determining 
T, upon ascertaining the delay access Da. Higher speed-up rates remove the access 
delay faster, but at the expense of noticeably more distorted output speech. Lower 
speed-up rates are less noticeable in the output speech, but take longer to remove the 

30 delay. Preferably, 0.08 < r < 0.15, and most preferably r .0.12, or 12%. Thus, in the 
most preferred embodiment, an access delay of Da = 60 msec is mitigated in a time- 



scaling interval T 500 msec, preferabry near the beginning of each talkspurt. Should 
the utterance then continue, no further mitigation is required since the time-scale 
compression during the time period T would have accounted for the entire access 
delay. The output of the ADR 154 is sent to the speech encoder 156 in preparation for 

5 transmission by the bit-stream transmitter 158. 

To maintain proper signal phase in voiced regions, preferably, only segments 
that are an mteger number of estimated pitch periods are cut from the signal In 
regions with long pitch periods where only a little bit needs to be removed, the cutting 
is deferred until the pitch period drops. Thus, it may take a little longer than a 

10 predetermined time-scaling interval T allotted for fully mitigating the access delay. 

In the context of the present invention, the VAD 152 preferably is external to 
the speech encoder 156, ralher than being part of the speech encoder, as in 
conventional implementations. This is because the speech must be time-scaled before 
it is sent to the speech encoder 156, which requires that the output of the VAD be 

1 5 known before the encoder is called into play. Furthermore, while the ADR 1 54 could 
be integrated into an encoder, it is simpler to implement it as a preprocessor. This 
way, a single ADR implementation may be used with any speech encoder. 

Fig. 4 presents a generalized flow chart 170 of a method to operate the 
communication device of Fig, 3 in accordance with the present invention. In step 172, 

20 the communication device is turned on and the AIP 150 outputs frames of data, 
whether or not voice is present. In step 174, the VAD 152 and the ADR 154 both 
receive the frames output by the AIP, with the ADR 154 temporarily buffering the 
frames, just in case the VAD determines that voice activity was present. In step 176, 
the VAD 152 checks for voice activity. If no voice activity is detected, additional 

25 frames are taken in and buffered and checked. If voice activity is detected, in step 
178, the VAD 152 sends an active signal to the control interface 164 and also to the 
ADR 154. In step 180, the control interface 164 requests a channel and in step 182, 
informs the ADR 154 and the bit-stream transmitter 158 that a channel has been 
allocated for the current talkspurt. In step 184, the ADR 154 obtains the access delay 

30 and determines the number of samples that it must cut from the talkspurt within the 
time period T. In step 186, the ADR 154 processes new frames from the AIP 150, 
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cutting samples in accordance with a predetermined algorithm, and sends the cut 
frames onto to the speech encoder 156 in preparation for transmission. In step 188, the 
ADR 154 checks to see whether a sufficient number of samples have been cut. If not, 
control returns to step 176 to process and make cuts in additional frames. If, however, 
5 it is determined at step 188 that a sufficient number of samples have been cut, at step 
190, the remaining frames are passed through to the encoder without fiirther cutting 
until, at step 192, the VAD 152 indicates that no further voice activity is being 
received in that talkspurt. 

After the talkspurt is over, an active-to-inactive transition occurs in the VAD 

10 152 and the VAD 152 sends an inactive signal to the handset=s control interface 164. 
When the handset=s control interface 164 receives and processes the inactive signal, 
this ultimately results in the traffic channel 160 being freed for reuse by the base 
station 142. The handset=s control interface 164 then waits for another active signal 
from the VAD 152, in response to another talkspurt. However, if the talkspurt is very 

15 short, e.g., less than the time period T of 500 msec, the system may not have enough 
time to completely remove the access delay. In this case, the bit-stream transmitter 
158 informs the handset=s control interface 164 that there is still data to send, which 
may defer freeing the traffic channel 160 until all the encoded packets have been 
transmitted. 

20 Fig, 5 presents a generalized flow chart 200, illustrating the steps associated 

with step 186 of Fig. 4. In step 202, the ADR 154 receives a frame from the AIP 150. 
In step 202, the ADR determines the pitch period P using the most recent portion of 
the received frame. Preferably, this is done by performing an autocorrelation of a 
terminal section of the frame, with earlier portions of that frame, and perhaps even 

25 earlier frames, by using various lags within some finite range The lag corresponding 
to the peak of the resuhing autocorrelation output is then taken as the pitch period P. 
The pitch period estimate P is used even when the speech is unvoiced. In step 206, 
the ADR subtracts one pitch period P worth of signal from the frame, although integer 
multiples of a single pitch period may be subtracted, if P is short enough. After the 

30 pitch period has been cut, a first segment of the frame located immediately before the 
cut portion, and a second segment of the frame comprising an endmost portion of the 
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cut portion are merged. As seen in steiJ.208, this is preferably done by an overlap-add 
technique which mixes the two segments so as to ensure a smooth transition. Finally, 
in step 210, the cut frame is sent on to the speech encoder 156 in preparation for 
transmission of the cut frame. 
5 It should be noted here that while the above description focuses on the access 

delay reducer bemg found in a handset, a similar fimctionality could also be found in a 
base station which must first establish/allocate a traffic channel before relaying a 
voice signal to the handset, and therefore must buffer and transmit the voice signal. In 
such case, access delay reduction may be employed in both directions. 
10 The above-described invention is now illustrated through an example which 

uses human speech, and a simulated communications device. The simulation used a 
sampling rate of fs = 8 kHz, a simulated access delay Da = 60 msec, a tim&scaling 
interval T = 500 msec, with the speech being processed using a frame length F = 20 
msec. 

15 Figs. 6a and 6b, present the speech waveforms illustrating the effect of the 

simulation. The input waveform 304 of Fig. 6a shows the unmodified first 750 msecs 
of a talkspurt input to an audio port. Mark 306 indicates the point at which the VAD 
152 has detected an inactive-to-active transition and thus outputs the active signal. 
The region to the left of mark 306 has been zeroed out, since this signal is not 

20 transmitted. The output waveform of 308 of Fig. 6b shows the time-compressed 

output of an ADR delay algorithm which is fed into the speech encoder. The start of 
the talkspurt has been delayed by a simulated access delay of Da = 60 msec. Mark 
3 10 is placed on the output waveform 60 msec after mark 306. A speed-up rate of r = 
0.12, or 12%, is used so that the 60 msec simulated access delay is mitigated within 

25 the time-scaling interval T = 500 msec. Thus, the input speech signal 304 is time 
compressed for the 500 msec after mark 306 to remove the access delay, the result of 
the compression being shown after mark 310 in the output waveform 308, As seen in 
Fig. 6b, the time-compressed waveform has similar characteristics to the original 
input waveform, but is shorter by the 60 msec synthetic access delay. However, after 

30 the 500 msec catch-up period, the input and time-compressed waveforms are time- 
aligned. 
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In the present example, a general purpose VAD based on signal power, such as 
that described in U.S. Patent No. 5,991,718, is used. The first few active speech 
frames from this VAD are placed in buffer associated with the ADR and, for various 
reasons, are not time-compressed, but rather are sent on to the speech encoder. When 
5 the transmission channel is granted, the obtained access delay Da is measured and 
converted to samples. At a sampling rate of 8 kHz, a simulated access delay Da = 60 
msecs corresponds to a total of 480 samples that must be removed over the tim& 
scaling interval T = 500 msec. This calls for a speed-up rate r = 0.12 = 60 msec / 500 
msec. Since there are 25 frames of length F = 20 msecs in a 500 msec time interval, 

10 on average, 480/25 = 19,2 samples should be removed from each frame. To ensure 
that the cutting process is Aon tracks, two accumulators are kept. One accumulator, 
called target coimt Tc, keeps track of how many samples should have been removed 
by the time the current frame is transmitted. Tc is initially 19.2 (since by the time the 
first frame is sent, about 19.2 samples should have been cut) and is incremented by 

15 19,2 with each passing frame. The second accumulator, called the remaining count 
Rc, keeps track of how many more samples must be removed to get rid of the entire 
access delay. Therefore, in the present simulation, Rc is initially set to 480, and then 
decreases, each time samples are cut from a frame during the processing. 

As discussed above, before subtracting any portion of the signal, a current 

20 pitch period was estimated. In the present example, this is performed by finding the 
lag corresponding to the peak of the normalized autocorrelation of the most recent Lc 
msecs of speech with varying lengths from Lmin to Lmax msecs= worth of 
immediately preceding speech, at step intervals of Lint. For the present example, Lc 
= 20 msecs (160 samples at fs = 8 kHz), Lmin = 2.5 msec (20 samples at fs = 8 kHz), 

25 Lmax = 15 msec (120 samples at fs = 8 kHz) and Lint = 0.125 msec (1 sample at fs = 
8 kHz). Thus, the range of allowable pitch periods is established by Lmin and Lmax. 
To lower the computational complexity, however, the autocorrelation preferably is 
performed in two stages: first a rough estimate is computed on a 2:1 decimated signal, 
and then a finer search is performed in the vicinity of the rough estimate with the 

30 undedicated signal. 
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Fig. 7 illustrates the autocorrelafion result 350 for pitch period estimation on a 
35 msec portion 352 of the signal presented in Fig. 6a. A 20 msec-long reference 354 
and a number of lag windows 356 for the autocorrelation are also shown. In Fig. 7 the 
autocorrelation result 350 is aligned with the tail end of the lag windows. The 
5 autocorrelation peak 358 corresponds to a pitch period estimate of P = 8.875 msec (71 
samples at 8 kHz) and is positioned one pitch period back from the end of the 35 msec 
portion 352. The calculated pitch period P, in samples, is compared to the current 
value of the target count Tc. If P > Tc, which may happen at the beginning of the 
talkspurt, no time-scaling is performed on the current frame and the next frame from 

10 the AJP is processed. If, however, P #Tc, a first portion of signal, having a length 
substantially equal to the pitch period P, can be removed from the input. Preferably, 
this first portion is removed from the most recent part of the input signal. 

Fig. 8 shows an overlap-add (OLA) pitch cutting operation for a portion of a 
speech signal sampled at a sampling rate of 8 kHz. The top waveform shows an 

15 original input frame 370 and the lower waveform shows the time^scaled frame 372 
after removal of a pitch period and the OLA operation. The input frame 370 has a 
lengthl60 samples, or 20 msecs, and extends between demarcation lines 374a, 374b, 
which designate the beginning and the end of the input frame 30, respectively. The 
time-scaled frame 372 extends between demarcation lines 374a and 374c, and extends 

20 for 20 msec minus the length of the removed pitch period. For input frame 370, the 
pitch period is 71 samples, or 8.875 msecs, and so the time-scaled frame is 89 
samples, or 11.125 msecs. As seen in Fig. 8, the 71-sample removed portion 376 of 
the input frame extends between demarcation lines 374c and 37b, at the end of input 
frame. 

25 The OLA operation combines a first segment 378 of the original input frame 

having a length Wl, which preferably is 1/4 of a pitch period, with a second segment 
380 of the original input frame, also of length Wl using windows 382 and 384, 
respectively. The first segment 378 belongs to a section of the pitch period 
immediately preceding the removed portion 376, and the second segment 380 comes 

30 from the endmost portion of the removed portion 376 at the terminal section of the 
frame. The two segments 378, 380 are combined by multiplying by their respective 



windows and adding the result, to thereby form a smooth, mixed portion 386 of length 
Wl, which forms the terminal part of the time-scaled frame 372. Thus, the forward 
portion of the time-scaled frame 372, seen extending between demarcation lines 374a 
and 374d, is an unmodified copy of the original input frame 370, while the terminal 
5 part of the time-scaled frame is a modified copy of a first section of the original input 
frame delimited by demarcation lines 374d and 374c, mixed with a copy of a second 
section of the original input frame delimited by demarcation lines 374e and 374b, 
The foregoing OLA thus results in a tune-scaled frame which is formed entirely from 
the original input frame, and therefore does not rely on signal from an adjacent, or 

10 other, frame. 

In the present implementation, the window length Wl is 1/4 of the pitch 
period. It should be kept in mind, however, that other window lengths may also be 
used. Also, as seen in Fig. 8, the windows are preferably triangular in shape. 
However, other window shapes may be used instead, so long as the mixture of the two 

15 windows is appropriately scaled. Regardless of the shape or length of the window, the 
OLA helps ensure a smooth transition at the terminal end of the time-scaled frame. 

After the OLA operation, the time-scaled frame is placed in an output buffer 
whose contents are subsequently passed to the speech oicoder 156. After the pitch 
period is removed, the target count Tc is decremented by the pitch period (in samples) 

20 and the remaining count Rc is decremented by the pitch period. The ADR continues 
time-scale compression on additional input frames until the access delay is removed, 
e.g., until Rc is below the minimum allowed pitch period. For the rest of the 
talkspurt, the input frames are handled directly to the speech encoder. At the end of 
the time-scaling mterval there may still be some residual delay. The maximum value 

25 of this residual delay is determined by the minimum allowable pitch period, which is 
Lmax of 20 samples, or 2.5 msec. On average, then, the residual delay is about half 
this amount, about 10 samples, or about 1.125 msec, which is reasonable for most 
systems. If required, the residual delay may be removed during an unvoiced segment 
of speech, where phase errors are not as noticeable. This, however, would increase 

30 the complexity of the implementation. 
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Additional short cuts are taken to lower-the complexity of the implementation. 
For example, since a pitch period will never be removed from a frame if Tc < Lmin, 
no pitch estimate is calculated if Tc < 20. Also, if the pitch period is low, it may be 
possible to remove two complete pitch periods from a single 20 msec frame, and this 
5 is allowed if Tc is more than twice the estimated pitch period. Furthermore, in the 
implementation, sample removal is always performed at the end of the most recent 20 
msec frame. 

The computational complexity of the implementation described above is 
dominated by the autocorrelation. The autocorrelation and overlap-add operations 

10 require a maximum of 5027 MACs, 108 compares, 55 divides, and 54 squar-root 

operators per iteration. Assuming MACs take one cycle, compares take 2 and divides 
and square-roots take 10 cycles, this yields total of 6333 cycles. The autocorrelation 
and OLA can be called once a frame. Thus, with a 20 msec frame size, this leads to a 
complexity estimate of approximately 0.3 MIP. The VAD is estimated to add another 

15 0.1 MIP for a total of 0.45 MIP. Decreasing the frame size to 10 msec would increase 
the possible frequency of autocorrelations and OLAs by a factor to 2, leading to a total 
estimate of 0.8 MIP for 10 msec frames. Changing thedegree of overlap, too, would 
also affect the computational complexity. 

Attached as Appendix 1 is sample C++ source code for a floating-point 

20 implementation of an access delay reduction algorithm in accordance with the present 
invention. 

While the above description is principally dfrected to wireless applications, 
such as cellular telephones, it should be kept in mind that time-scale compression of 
speech has applications in other settings, as well. In general, the principles of the 

25 present invention find use in any type of voice communication system in which 
statistical multiplexmg of channels is performed. Thus, for example, the present 
invention may be of use in Digital Circuit Multiplication Equipment and also in 
Packet Circuit Multiplication Equipment, both of which are used to share voice 
channels in long distance cables, such as undersea cables. 

30 And while the above invention has been described with reference to certain 

preferred embodiments, it should be kept in mind that the scope of the present 
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invention is not limited to these. One skilled in the art may find variations of these 
preferred embodiments which, nevertheless, fall within the spirit of the present 
invention, whose scope is defined by the claims set forth below. 
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